Creation and use of virtual places

ABSTRACT

An apparatus, method and system facilitate efficient creation of virtual places and provide tools for using the virtual places. The virtual places include a virtual real estate listing, newsworthy place and a virtual box seat. Tools are provided including an automatic declutter tool and a staging tool.

CROSS-REFERENCE TO RELATED APPLICATION

This application claims priority to and is a continuation of U.S. patentapplication Ser. No. 14/247,190, filed Apr. 7, 2014 (now U.S. Pat. No.9,595,136 issued Mar. 14, 2017), which claims priority to and is acontinuation of U.S. patent application Ser. No. 13/155,380, filed Jun.7, 2011 (U.S. Pat. No. 8,694,553 issued Apr. 8, 2014), which claimspriority pursuant to 35 U.S.C. § 119(e) to U.S. provisional applicationSer. No. 61/352,071, filed Jun. 7, 2010, to U.S. provisional applicationSer. No. 61/352,237, also filed Jun. 7, 2010, and to U.S. provisionalapplication Ser. No. 61/375,394, filed Aug. 20, 2010, which applicationsare specifically incorporated herein, their entireties.

BACKGROUND

1. Field

The present disclosure relates to computer services for entertainment,education and commerce.

2. Description of Related Art

Planning residential space utilization can be a difficult problem forordinary consumers to manage without professional help, yet the cost ofprofessional assistance cannot be afforded for many people.Three-dimensional computer modeling tools exist to assist in spaceutilization, but setting up such tools for use in planning a particularspace configuration in beyond the abilities of many people who mightotherwise be able to make use of such tools. Space planning is a problemthat often arises in the context of residential real estate,particularly when considering the purchase of a new home. However,numerous practical considerations such as affordability of professionalservices, computer skills, time, and access to properties for sale havemade it impracticable for most people to make use of computer modelingin the selection of residential real property.

Similar barriers have prevented widespread use of computer modeling asan educational or entertainment tool in the fields related to currentevents, for example, in news reporting or related commentary. Newsorganizations often supplement content provided on broadcast channels orin print with Internet content, sometimes including interactiveapplications, to attract readers and increase page views. However,cost-benefit considerations prevent the widespread use of computermodeling to report or comment on current news events.

With increasing mobility and dispersal of people throughout the world,people with an interest in viewing live events, such as sporting eventsfor their “home” team, find themselves increasingly unable to attendsuch events due to geographic distance and other factors. In addition,many people find it inconvenient, undesirable, or even dangerous or, forthis with mobility problems, impossible to attend such events.

In addition, there is a need to allow people to better enjoy sporting orother events by sitting close to action on the playing field, or evenhaving a point of view within the action. There are a limited number ofseats near the action, so that even if people are physically able toattend a baseball game, for example, there are a limited number of seatsbehind home plate. Similarly, certain seats are impossible to occupy,such a seat on the pitcher's mound.

SUMMARY

The present disclosure presents a method, system and apparatus forcreation and use of virtual places. In an aspect, a method for providinga virtual 3-D model of a defined physical place may include obtainingimages of a physical place. The images may be obtained in response to atriggering event related to the defined physical place. The method mayfurther include determining a surface geometry of the defined place andsupplying texture maps to the surface geometry, using the images. Themethod may further include creating a 3-D model of the defined place ina computer memory using the surface geometry and texture maps, andproviding a user interface for remote access to the 3-D model.

In additional aspects, the method may further include monitoring queriesprovided to a search engine to detect the triggering event comprising arate of queries including an identifier for the defined physical placeexceeding a threshold. The method may further include monitoring acurrent popularity of online news stories to detect the triggering eventcomprising a relative popularity of online articles that include anidentifier for the defined physical place exceeding a threshold. Themethod may further include monitoring a real estate listing to detectthe triggering event. The method may further include monitoring a newsfeed to detect the triggering event comprising a newsworthy event takingplace at the defined physical place. In such case, the obtaining of theimages may include obtaining video or photographic images from newsreports of the newsworthy event. The method may further include enablinguse of the 3-D model in an online virtual world environment, to providethe user interface. In addition, the method may further includeobtaining the images by querying an image database. The method mayfurther include processing selected ones of the images to remove objectssmaller than a specified size from the selected images, in response to auser declutter request.

In a separate aspect, a method for configuring a physical space mayinclude creating a 3-D model of a physical place in a computer memoryusing the surface geometry and texture maps taken at least in part fromdigital images of the physical place. The method may further includeserving the 3-D model in a remotely accessible virtual world interactiveinterface, including independently modeled digital objects appearing inthe digital images. The method may further include linking the virtualworld interactive interface for access via an online real estate listingfor property including the physical place.

In additional aspects, the method may further include receiving inputspecifying a minimum object size, and decluttering the 3-D model byremoving objects smaller than the minimum object size. The method mayfurther include enabling a user to select ones of the independentlymodeled objects for removal from the 3-D model, using the virtual worldinteractive interface, and creating a record of remaining ones of themodeled objects in response to user removal of one or more of themodeled objects. The method may further include enabling the user toselect additional modeled objects from a catalog for adding to the 3-Dmodel, and creating a record of selected ones of the additional modeledobjects in response to user selection of one or more of the additionalmodeled objects. The method may further include enabling the user todetermine placement of the remaining ones of the modeled objects and theselected ones of the additional modeled objects in the 3-D model, andcreating a placement record. The method may further include generatingan order for staging the physical place, using the record of remainingones of the modeled objects, the record of selected ones of theadditional modeled objects, and the placement record.

In a separate aspect, a telepresence method may include linking arobotic device placed in a physical place to an interactive interfaceincluding a virtual 3-D model of the place. The telepresence method mayfurther include tracking virtual motion of an avatar in the interactiveenvironment relative to the virtual 3-D model. The telepresence methodmay further include controlling movement of the robotic device in thephysical place to indicate virtual motion of the avatar in the virtual3-D model. The telepresence method may further include emitting a beamof light from the robotic device to indicate a direction of gaze of theavatar. The telepresence method may further include operating an audiolink between the robotic device and a user controlling the avatar in theinteractive environment. The telepresence method may further includeprojecting an image from the robotic device to indicate a position ofthe avatar in the virtual 3-D model. The telepresence method may furtherinclude projecting the image from the robotic device including an imageof a user controlling the avatar in the interactive environment.

Aspects of the above methods and similar methods may be embodied in acomputing device comprising a processor, a memory, and a networkinterface. The memory may hold instructions that, when executed by theprocessor, cause the computing device to perform method and operationsas described above.

Further examples and details of the present technology may be obtainedfrom the following detailed description. The drawings referenced in thedetailed description are first described briefly.

BRIEF DESCRIPTION OF THE DRAWINGS

FIG. 1 is a block diagram showing an example of a system for performingone or more methods as described herein related to creation and use of avirtual 3-D space.

FIG. 2 is a block diagram showing an example of a system for perform inone or more methods as described herein related to telepresence.

FIG. 3 is a flow chart showing an example of creating a using a virtual3-D space in a news or education application.

FIG. 4 is a flow chart showing an example of creating a using a virtual3-D space in a real estate application.

FIG. 5 is a flow chart showing an example of a telepresence method.

DETAILED DESCRIPTION

It is desirable, therefore, to provide a control method, system andapparatus for creation and use of virtual places in education,entertainment and commerce that provides features not provided in theprior art.

The headings set forth below are merely to aid organization andreadability of the disclosure, and do not limit the disclosed examplesor concepts.

Real Estate and Space Configuration

A group of photographic images, measurements, video segments, or acombination thereof is used to image and/or measure a physical place orfacility, such as a residence, and optionally some or all of itscontents. In an aspect, two dimensional photographic images may beutilized in combination with software that converts two dimensionalimages into three dimensional models, such as by using the Make3dalgorithm developed by computer scientists at Stanford University, or asimilar method. Objects of known size may optionally be used to providescale. For example, a dollar bill seen sitting on a table is of knownsize, and may be utilized to determine the size of the objects in theroom.

The image may be converted into a three-dimensional (3-D) computermodel, sometimes referred to herein as a 3-D virtual model, using asemi-automated or automated algorithm operating on input images andoptionally, measurements. The three dimensional model may be comprisedof a plurality of three dimensional objects, and may be configured so asto allow additional three dimensional objects to exist within the threedimensional model. Actual images of objects, walls, or other elementsfrom the facility may be used to generate the textures utilized toprovide texture or realism to each model. For example, a wall within thefacility may be covered with patterned wallpaper. The image of the wall,covered by wallpaper, is then used as a texture map for the wall, makingthe wall appear not just dimensionally representative of the wall in thephysical facility, but visually representative as well.

In an aspect, the signal strength of at least one of a plurality ofsignals, such as an 801.11N network signal, a cellular telephone networksignal, a cordless telephone signal, or a cellular data network signal,is measured and recorded during the imaging of the facility. The signalstrength at various selected locations within the place to be modeledmay be recorded in a data structure for use with the 3-D virtual model.The signal strength represents a location-specific parameter that may beof interest to a person who later uses the model to obtain informationabout the place that the model represents.

In another aspect, the semi-automated or automated algorithm identifiesindependent objects within the place or facility, for example, tables,chairs, beds, or other furnishings. These objects may then be modeledindependently as objects that can be independently manipulated withinthe 3-D virtual model of the place. Thus, for example, a bedroom mightbe imaged and a three dimensional space representing the bedroom wouldbe generated, together with three dimensional objects representing thebed, the nightstand, the television, the dresser, and, in someimplementations, even some fixtures that could be moved via alterationof the physical facility, such as light switches, power plugs, andoverhead lights. These objects can then be rearranged by users of thefacility, replaced with objects drawn from a retail style catalog, orotherwise manipulated independently of each other and of the facility.

In an aspect, “anchor points” representing physical characteristics ofthe place being modeled, for example, windows, doors, power plugs,telephone, cable, and network plugs, wireless signal strength, airconditioning and heating vents, smoke detectors, and similar relativelyfixed characteristics of the facility, are mapped or recorded.Proximity, strength, or other characteristics of the anchor points maybe used to guide, limit, or assist users in later manipulation ofobjects within the facility. As an example, a user determining where anew television might fit within a room might specify that thetelevision's six foot long plug must reach an outlet, should be locatedwhere a cable can be run to the television from a cable outlet withoutcrossing a walkway, and should be located where adequate wirelessnetwork signal may be received. User interface software for using the3-D virtual model may then provide the user with a series ofsuggestions, ratings, or other indicia of appropriate placement of a newtelevision.

In an aspect, the mapped facility is made available via a wide areanetwork. Via network access, users such as interior designers or thelike may be granted access to a 3-D virtual model of or a residence orother private space to assist with design ideas. Data from merchants maybe incorporated so that a user may place new furniture, artwork, orother items within the 3-D virtual model to determine fit, look,placement and other factors normally known to the user only afterphysically placing the items in the facility, or known roughly to theuser by utilizing physical measurements of length of walls and similarcharacteristics.

A virtual facility using 3-D model of the physical place may be providedin an online multi-user environment virtual world environment, or as astand-alone virtual facility, using virtual world software. An owner ormanager of the virtual facility may invite others, in the form of imagedpersons, avatars, or other representative agents, to be presentvirtually within the virtual facility. Real time events within thevirtual facility may be transmitted over the network to other users.Similarly, real time events may be simulated, such as by embedding avideo feed over the television object within the facility. The simulatedevent may correspond to an actual event taking place within thecorresponding physical facility, but need not do so.

In another aspect, an automated “declutter” feature is used duringcreation or use of the 3-D virtual model, whereby items meetingspecified criteria are automatically hidden or, optionally, not added,to the virtual facility or portions thereof. The declutter feature mayoperate as an image processing or modeling tool that excludes objectssmaller than a defined size from a designated part or all of a 3-Dmodel. The defined size threshold may be defined by the user. Forexample, a user may select a bathroom area for decluttering any objectshaving a largest dimension less than 12 inches, causing the declutteringto exclude medicine bottles, toothpaste tubes and similar clutter fromappearing in the 3-D virtual model of the bathroom. Decluttering may beperformed at an image processing level to remove specified objects fromimages used in creation of a 3-D virtual model, either before or afterthe model is created. In the alternative, the 3-D virtual model may begenerated with independent models for all objects appearing in theinitial images, and smaller modeled objects selectively removed from thespace using a size feature. Of course, when objects are independentlymodeled, an owner of the virtual space may simply select and remove anyundesired objects using a selection tool.

In another aspect, a selective object viewing feature is provided.Optionally, a user may determine that certain objects (including areas)are shown only to persons with permissions to see those objects, or tono persons. Thus, for example, family members may be permitted to seethe bedrooms and their contents, and the master bathroom, but not itscontents. Continuing the example, non-family members virtually visitingthe facility may be restricted from viewing such objects or enteringthose areas. For further example, permission from the owner or managerof a virtual place may be required to enable a user to view object ofless than a specified size, or objects that are specially designated asprivate objects.

The creation and use of virtual places may include a real time or nearreal time news location reconstruction and touring facility. Utilizingvideo, stills, and other images or descriptions from the site of a newsevent, together with pre-existing models of that site, if any, a virtualrepresentation of a place related to a news event may be created. Thismay take the form of monitoring various news channels and combining newsfeeds from third party sources, closed captioning data, OCR of textoverlays on the screen and text within the images (for example, anaddress painted on a curb), to determine that a facility is being shown.The facility is then reconstructed in virtual 3D form and set up onlineas a self-contained virtual environment, using any suitable virtualworld hardware/software system. In the alternative, the virtual 3D modelof a news site may be includes as part of an existing virtual worldsystem. In either case, users may enter and tour the virtual news siteby remotely accessing the news site.

A virtual tour of a plurality of facilities is also disclosed, wherebythe facilities may be arranged in a manner that does or does notcorrespond to their actual physical locations. For example, a tour ofstars homes may be implemented where existing images of home interiors,for example from MTV's “Cribs”, from blueprints on file with planningagencies, or from a combination of one or more of those or othersources, are used to generate virtual 3D copies of such homes. The homesmay be placed adjacently on a virtual street, or located within amapping system that reflects their real world locations, or in somecombination of actual and artificial locations. Such facility may beintegrated with a satellite view mapping system, such as Google Maps orGoogle Earth, so that a user may be guided virtually through a map orimage of the area to the house, at which point the user would enter theinventions disclosed herein and be able to tour the interiors.

Users may be allowed to modify the interiors in a non-destructive mannerby creating a different dimension or separate forked implementation ofthe facility, whereby their changes are viewable to them only, to thosethey permit to see them, to viewers who desire to see the forkedimplementation, or to such other group as the user or system operatordetermines.

A virtual shopping facility is disclosed whereby a user is presentedwith a one or more images of a possible purchase located within thevirtual facility. A virtual sales person is disclosed, whether operatedby a human being, and automated process, or a combination thereof. Theuser may, in one implementation, be presented with a plurality ofside-by-side or sequential images showing different optional purchasesin place within a home. As an example, a user seeking to purchase a newtelevision may view numerous televisions placed in one or a plurality oflocations within the room where the television is to be placed. Thesalesperson may optionally assist by moving various items within theroom to rearrange the organization of the room to assist in reaching apleasing arrangement. Advantageously, the end user may thereby receivethe benefit of modeling expertise without having to pay a discrete fee;instead, training costs and the like may be absorbed as a generalmarketing expense.

A wheeled, flying, otherwise mobile, or stationary camera, audio feed,or a plurality of the one or more of those devices may be utilized toupdate the arrangement, contents, and status of the facility. In oneimplementation, various fixed cameras are used. Such audio and/or videofacilities may also be used to virtually tour the facility in real time.

An indicator light, sound, or actual object is disclosed that permitspersons actually within (or virtually within or viewing) the facility toidentify the location and/or direction of view of a person virtuallywithin the facility. For example, a virtual visitor looking at apainting may be indicated by the presence of a laser pointer dot on thepainting. The laser dot may be configured to indicate a particular user,for example using computer-controlled mirror system to generate a visualpattern unique to the person that is indicated. This indication may beaccompanied by, or take the form of, a video image. For example, in thereal facility, a projection system may be used to place a projectedimage of a viewer on an object, indicating that the viewer is looking atthe object. In addition, an audio system may be used to play an audiofeed from the user, or to provide an audio feed from the physicalfacility to the virtual facility in the virtual environment. In thisway, a virtual visitor looking at a painting could may with thosephysically present within the facility using the audio system connectedto a computer network, and discuss the painting or other things. Thosephysically present would have an indication of the direction of gaze ofthe virtual visitor, which may be identified by following the virtualvisitor's pupils, or simply by indicating the general field of viewavailable to the virtual visitor, the direct gaze of the visitor'savatar, or the center of the field of view of the visitor.

A shopping and delivery system may be provided whereby users purchaseitems they want within their physical facility, and delivery personnelare provided with a plan and are provided with instructions as to how todeliver and where to install the purchased items. For example, thedelivery personnel may be granted access to the corresponding virtualfacility or a printout or other plan generated therefrom. In addition,such a plan may include an indication of placement of the items to bedelivered within the space. For example, if the salesperson virtuallymoved a couch to make room for a television, the installers may beinstructed to do the same within the real facility. Installers mayupdate the image of the virtual facility, or simply indicate that thealternative arrangement proposed by the sales person had beenimplemented, thereby updating the arrangement of the facility.

A permissions and sales system may be provided whereby items purchasedor available for purchase in the real world may be displayed within thevirtual facility. In an aspect, items, particularly brand name items,present in the real world may be licensed to appear in the virtualworld. In this manner, a Sony television in the real world facilitywould be permitted to appear within the virtual facility. A prohibitionmay be imposed on the presence of some categories of items, includingall categories of items, or particular items, within the virtualfacility unless (or optionally regardless of whether) they are presentwithin the real world facility. Items may be licensed or placed withinthe virtual facility on paid or other terms. Items not owned in the realworld may be purchased or otherwise acquired and displayed within thevirtual facility.

An automated and partially automated “staging” system is disclosed,whereby real estate listed for sale or rental in the real world isimaged and used to create a 3-D virtual model. Objects and furnishingspresent in the virtual facility may be removed using a declutteringfeature, or selected objects may be removed using manual selection.Then, the virtual facility is furnished using virtual furnishings andother modeled items selected from a catalog or library of itemsprofessionally prepared and collected for staging real estate, whetherresidential or commercial. The selected virtual furnishings are stagedwithin the virtual version of the real estate, optionally using theservices of an interior decorator or other trained person. The virtualitems for staging may be added to models of existing furnishing alreadypresent in the real facility and modeled in the virtual facility. Apreferential weight may be assigned to items that are less expensive toplace within the facility, such as items that weigh little, that requirethe removal of fewer existing furnishings, and so forth. When a personindicates interest in the property, the real home may staged in a mannerthat matches the staging of the virtual home before the interestedperson is given access to the real home for consideration of purchasingit. The staging system may be done automatically via algorithms, via asystem where the algorithms make some or all of the initial choices buta real estate agent or other person makes changes or corrections, or bya system where the person is assisted in their choices. For example, theperson doing the staging may be being presented with lists of placeswhere an object might fit, or be enabled able to virtually move objectsaround in the virtual facility using a 3-D modeling application.

The use of the virtual facility to redecorate or to alter the appearanceof the facility may be assisted in the same or a similar manner. In thisway, a user might hire a virtual interior designer who is able to workwith the user to redesign the home, with the computer handling thedetails such as whether an item fits in a given space, proximity toelectrical outlets, adequacy of natural or artificial light, and otherfactors.

Virtual Box Seat:

In another aspect, creation and use of virtual places includes virtualbox seats, whereby those people choose to attend an event by viewing itoff-site in virtual box seats. In an aspect, a variant of the inventionsmight operate as follows: An enclosed or semi-enclosed area is locatedwithin another establishment, such as a restaurant. The area isreferenced herein as the “virtual box”. The virtual box preferablycontains one or more displays, preferably capable of displaying movingimages in three dimensions. In an aspect, such displays would notrequire the use of 3-D glasses, such as prototype displays introduced bydisplay manufacturers in 2010. The virtual box is connected to one ormore cameras, preferably capable of transmitting three dimensionalimages, which cameras are located at the event to be watched via thevirtual box.

Taking as an example watching a hockey game from a virtual box, camerasmay be placed behind each goal, at edge of the ice near the center line,and above the hockey rink in a position corresponding to traditionalstadium boxes. The video feed to the virtual box may be controlled toenable user switching between viewpoints from within the virtual box.Fans of the home team might choose to locate their virtual box behindthe away team's goal during the first period, at the center line duringthe second period, and behind the home team's goal during the thirdperiod, for example. In an alternative implementation, the cameras maytrack the action, so that the virtual box point of view moves with theplay either in real time, at the start of each play, as dictated by arule set created by the team, box users, or other party, or one demand.“Tracking the action” could involve smooth tracking, as might befacilitated by a camera on rails, or “jump” tracking, where the virtuallocation jumps from one to another of a plurality of cameras.Alternatively, smooth tracking may be accomplished by digitallycombining portions of the points of view of a plurality of cameras wherethe camera images overlap or abut each other. In this manner, imaginethat 100 cameras are used, set back slightly from the ice, one every sixfeet, to ring a hockey rink. The point of view of each camera coversseven feet. By combining the full or partial view from multiple cameras,it is possible to digitally move the point of view of the virtual boxfreely, to simulate any position around the hockey rink. Used inconjunction with football, for example, the box might be made tomove—virtually moving its point of view—to line up the virtual box pointof view to match the location of the football at the start of each play.

Multiple boxes may be used simultaneously, each sharing the same virtualposition on the field. Regardless of the extent virtual position on thefield, each box may have a side wall looking in on another virtual box.In this way, a husband deployed with the military in Iraq might enjoy aseat in a virtual box next to his wife, in a different virtual box inLos Angeles. The shared wall would, in an aspect, be contiguous with theimage on the front of the virtual box, so that it would appear whenlooking at the front right corner of the box, where the front image andthe adjoining virtual box image join, as if the user is actually sittingnext to the occupants of the second virtual box. The transmission ofimages between the boxes may be three dimensional as well. Suchtransmission could be “muted”, blanked, or otherwise controlled by usersin one or both boxes, either by individual choice or by consensus. Thevirtual positions of the two adjoining boxes may be set so that thedisplays in each box correspond to the view of the field that wouldexist if the boxes were actually adjoining. Alternatively, the boxescould enjoy differing views. The portion of the video on the side of thevirtual box that looks out at the field (i.e. a person in a virtual boxlooks to the right and sees, on the right wall, part of the field, andthe people on the box to the right) may be controlled to display theview that the users of the virtual box would expect to see if the boxeswere located in virtual adjacent positions relative to the field, evenif the boxes are located in virtual non-adjacent positions.Alternatively, such portion of the view may reflect what the persons inthe adjacent box actually see, even if positioned in a non-adjacentvirtual position. Finally, a combination make be used, where there is anindicator of the view available through the other virtual box, in oneimplementation by displaying the view available on the other virtual boxin some other place in the first virtual box, such as on the back wall.Optionally, the back wall may also be used to display fans (or real,stock footage, avatars, or artificially generated). Optionally, the backwall, ceiling, overlays to the front wall, or other surfaces may be usedto carry additional game data, data related to other events, oradditional views of the game. In this manner, for example, a single boxmay contain a front-facing wall showing the view from the home team'sgoal, and a back wall showing the view from the away team's goal.

When adjacent boxes are connected, the distance between the location ofeach box and the location of the original event may create timingproblems. For example, a user in Sydney, Australia viewing a game from avirtually adjacent box to his brother in London, where the gameoriginates in Los Angeles, Calif., might have to endure a 500 ms delayin the transmission of the video from the game to his box, and a 250 msdelay in the transmission of his reaction to the other box in London anda 100 ms delay in the transmission of the game to London. To prevent thedelay from impairing the realism of the experience (such as by seeingthe fans in the London box cheering a fraction of a second before a goalis scored), the virtual boxes and/or the head end at the event and/orthe head end transmitting the event, or a combination thereof, exchangetiming data and agree on a delay greater than or equal to the minimumdelay necessary to ensure near-simultaneous reception and transmissionof reactions and events. Thus, the transmission of game events to Londonmight be delayed an additional 1900 ms, making the events take 2000 msto display in London. The transmission of game events to Sydney might bedelayed an additional 1500 ms, for a 2000 ms delay in game transmissionto Sydney. Optionally, the connection speed between the boxes would bemade identical (so if three boxes were adjacent, similar levelingtechnology ensures simultaneous transmission of reactions to all boxes).The portion of the side view showing action on the field would bedelayed by a different amount than the audience portion, ensuring thatall views of the field action are timed to correspond to each other (sothat the portion viewed in the side view are not displaced temporallyfrom the front portions). Where one of the side views is not anadjoining virtual box, but a real physical box or simply actual stadiumseats, the side view should preferably share the delay utilized by thefront view.

The virtual point of view may actually be on the field. In an aspect,the cameras are placed in front of any visual barriers (such asplexiglass in hockey), or such barriers are digitally removed. The boxseats could thus appear to be directly on the ice. In football, forexample, the box seat might be virtually located directly on the goalline. The point of view may also be altered digitally to move up anddown the field with the action.

The ambient sound level may be controlled by the users of the virtualbox. For example, users watching a concert might make it louder orquieter. The location of the sound receivers need not correspond withthe point of view in use in the virtual box. The location of theapparent sound reception may be digitally or otherwise altered tocorrespond to the virtual position of the box as the box moves virtuallyaround the field.

The box may be licensed or sold to a user group on a plan where the foodor other accoutrements are included. In an aspect, a door to the box islocated in a location similar to that where a door would be located in aphysical box seat. Preferably, the door is adorned with an imagetransmission device (for example, another 3-D monitor) so that the doordisappears or at least blends into the other portions of the displaywhen not in use.

For events where items need to be transmitted to the event or from theevent, printers, 3-D printers, t-shirt printers, money reception andtransmission devices, haptics interfaces, and similar devices areintegrated. For example, a user in the virtual box may wish to visit thesouvenir stand. One side wall becomes the souvenir stand. The user findsa t-shirt he wants and orders it. It may be then printed on a t-shirtprinter located in or near the box location, or, in the alternativeshipped to an address specified by the user or to the location of thebox. In another example, a user may be watching a private magic show ordance and wish to tip the performer. The user puts a bill into a billreceptor in the virtual box or charges a credit card, and a bill or someother token or indication that a payment has been made for the performeremerges from a machine at the event. Note that the virtual box may beused to view night clubs, magic shows, small club concerts, largesporting events, or a completely virtualized environment such as aCGI-generated set, and other environments.

These inventions allow concert-goers to have virtual box seats on stage,in the front row, or even in a physically impossible location hoveringabove the audience and stage. Displays may be placed on any surfacewithin the box, including on the floor and furnishings, and even onclothes of persons within the virtual box. One aspect of this is that itmay be utilized to make it appear as if the floor or furnishings areinvisible, or that the user is floating above or around the event.

Existing surround sound technology is used to recreate the sound at theevent.

Loud sounds or events, such as fans stomping their feet, may beaccompanied by generation of vibrations in the virtual box. Othercharacteristics of the environment, such as smells, temperature, winds,or rain, may be recreated within the virtual box to add to theverisimilitude. Such features may optionally be altered or declined bythe users of the virtual box.

It is sometimes preferable to adopt the point of view of a player withina game, or a performer in a concert. In one implementation, one or moreplayers, umpires, participants, or fans wear (physically or via digitalreconstruction from other signals) transmission devices. Preferably, thetransmission devices correspond to the view from each eye, and the soundreceived at each ear. The transmission is sent to the users eitherthrough the virtual box sound and video recreation facilities, throughglasses, headphones, or a combination thereof. In such animplementation, users could choose to view a baseball game through theeyes of a pitcher, or feel and experience a hockey game through the eyesof a forward. When the forward is checked against the boards, the soundand visual disorientation would be shared with those in the box. Amotion sensor, or an algorithm that determines when noise, video input,or a combination thereof is likely to indicate a physical impact withthe player, is used to optionally create a shake motion within thevirtual box.

If preferable to avoid motion sickness, limitations on the velocity withwhich the images may move may be implemented. Optionally, images may bereduced to two dimensions temporarily or for the duration of the eventor longer.

Another implementation of these inventions is to transmit the imageand/or sound data through glasses, either independently or incombination with the use of a virtual box, or in combination with atelevision or other video display device. In an aspect, a user maychoose to virtually “inhabit” one of a plurality of players in a game,or performers in a concert, changing among players or performers as theuser desires or based on a ruleset. For example, a rule for viewingbaseball may specify that the view baseball is taken current batter'seyes except during a fielding play. Point of view glasses and audioinput may be utilized to enhance a virtual box by providing additionalpoints of view for individual users of a box when other users may wishdifferent points of view.

Users of the box may optionally change games or events mid-way, duringhalf-times, or even have different events taking place on a plurality ofthe walls within the virtual box.

FURTHER EXAMPLES

FIG. 1 is a block diagram showing an example of virtual place creationand management system 100 such as may be used to perform methodsdescribed herein. System 100 may comprise, for example, a computer 101including at least a processor or CPU 102 and a memory 104 for holdingdata and program instructions. When executed by the CPU 102, the programinstructions may cause the computer 101 to perform one or more methodand operations as disclosed herein. The computer 101 may furthercomprise or be connected to a display device 106 for providing agraphical or text display of software output, and a user input device110, for example a keyboard, mouse, keyboard, microphone, touchscreen,touchpad, or some combination of these and similar input devices. Thecomputer 101 may be in communication with a Wide Area Network (WAN) 112,for example, the Internet, via a network interface component 108.

The computer 101 may receive data including user input from a clientcomponent 116, which may be in communication with the computer 101 viathe WAN 112. A client component may include hardware elements similar tocomputer 101, but in a form factor for client use. In an embodiment, theclient 212 may be embedded in a user interface controller for a virtualbox seat, an include microphone input. The computer 101 may provideoutput to the client 116 in response to user input. The output mayinclude a virtual world interface for accessing a 3-D virtual model of aplace, including operating a avatar within a 3-D model, editing the 3-Dmodel or objects contain in the model, or otherwise interacting with thevirtual 3-D model. In a separate aspect, the output may include videodata for display on one or more surfaces inside of a virtual box seatenclosure, using a projector or other display technology.

The computer 101 may receive image data from an image server 114. In anaspect, the image data may include real-time, or near real-time videodata for processing and supplying to a virtual box seat apparatus. Thecomputer 101 may be part of such an apparatus. In a separate aspect, theimage data may include image data from imaging a particular place. Thecomputer may receive the place-related images from an image server 114,which may be implemented as a search engine for locating images on othernodes of a computer network, using an indexing system. In thealternative, the image server may be a dedicated for holdingplace-related data for a specific purpose, for example privatereal-estate related images. Image data may also be stored in the memory104 or other memory in communication with the computer 101.

FIG. 2 is a block diagram showing an example of a telepresence system200 for indicating information about use of a virtual 3-D model 222inside of the physical space 202 on which the model 222 is based. Thesystem 200 may comprise a virtual world interface server 210, which maybe configured similarly to the computer 101 shown in FIG. 1. The virtualworld server 210 may provide software and data to one or more remoteclients 212 for accessing and using a 3-D virtual model 222 of aphysical place 202, via a WAN 208. A robot 204 may be located in thephysical space 202 and in communication with a controller 206. Thecontroller 206 may be in communication with the client 212 via the WAN208. The controller may determine the location and orientation of therobot 204 relative to the physical space 202 using a vision system orother data collection device. The robot 204 may have, but is notrequired to have, a locomotion system capable of moving the robot aroundthe space 202 in translation 218 and rotation 220, under the control ofthe controller 206. The robot 204 may include a light emitting device228, for example, a laser, light emitting diode, lamp, or projector. Thelight emitting device 228 may be controlled by the controller 206 todirect a light beam 216 or projected image in a specific direction oralong a specific vector.

In operation, the server 210 may serve programs and data to the client212 to enable interactive use of a 3-D model 222, including operating anavatar 224 inside of the model. The avatar 224 may responds to userinput control from the client 212 to move within the modeled space 222.In addition, the client experiences the modeled space 222 through aviewpoint, which may be aligned with an apparent avatar view asindicated by orientation of modeled avatar eyes, may be determinedindependently of any avatar configuration, or may be determined based ona combination of avatar state and independent input.

In an aspect, a user viewpoint of the model space 222 may be indicatedin the physical space 202 using the robot 204 and the light beam 216.For example, if the object 226 appears in the center of the field ofview of the current viewpoint being used by the client 212, thecontroller 206 may receive viewpoint information from the client 212 orserver 210 and cause the robot to direct a light beam 216 onto thecorresponding object 214 in the physical space. In addition, thecontroller may cause the robot to move in the physical space to reflectthe current position of the avatar 224 in the modeled space 222. In thisway, a person inside of the physical space 202 may be kept informed ofactivities, especially including the gaze, of persons viewing or usingthe modeled space 222. This may be useful for monitoring user interestin various objects in a space. The modeled space 222 may in someinstances include live video data from the physical space, for example,when a performance is going on and projected in real time or near realtime inside of a surface in the physical model. The robot 204 maysimilarly be used to dispense tips, vouchers, or other physical objectsin the physical space, in response to payments or requests made using aclient interacting inside of the virtual space 222.

In an aspect as diagrammed in FIG. 3, a method 300 for providing avirtual 3-D model of a defined physical place may include obtaining 302images of a physical place. The images may be obtained in response to atriggering event related to the defined physical place. Furthervariations and details for obtaining images, or triggering the obtainingof images, are described hereinabove and below. The method 300 mayfurther include determining 304 a surface geometry of the defined placeand supplying texture maps to the surface geometry, using the images.Any suitable method may be used. The method 300 may further includecreating 306 a 3-D model of the defined place in a computer memory usingthe surface geometry and texture maps, and providing 308 a userinterface for remote access to the 3-D model.

In additional aspects related to the operation 302, the method 300 mayfurther include monitoring queries provided to a search engine to detectthe triggering event comprising a rate of queries including anidentifier for the defined physical place exceeding a threshold. Themethod 300 may further include monitoring a current popularity of onlinenews stories to detect the triggering event comprising a relativepopularity of online articles that include an identifier for the definedphysical place exceeding a threshold. This may be useful, for example,in providing virtual 3-D models enjoying current popular interest due toevents in the news. In addition, the method 300 may further includemonitoring a news feed to detect the triggering event comprising anewsworthy event taking place at the defined physical place. In suchcase, the obtaining of the images may include obtaining video orphotographic images from news reports of the newsworthy event.

The method 300 may further include monitoring a real estate listing todetect the triggering event. For example, a realtor may request a 3Dvirtual model be created and made available to aid in marketing a realestate listing. In such cases, the required images of the property mayhave already been obtained and made available through an onlineelectronic listing service. The method may further include enabling useof the 3-D model in an online virtual world environment, to provide theuser interface. In addition, the method may further include obtainingthe images by querying an image database, which may include a searchengine for image data.

The method 300 may further include processing selected ones of theimages to remove objects smaller than a specified size from the selectedimages, in response to a user declutter request. Further detailsregarding features and aspects of decluttering are provided in thedescription above.

In a separate aspect as shown in FIG. 4, a method 400 for configuring aphysical space may include creating 402 a 3-D model of a physical placein a computer memory using the surface geometry and texture maps takenat least in part from digital images of the physical place. The method400 may further include serving 404 the 3-D model in a remotelyaccessible virtual world interactive interface, including independentlymodeled digital objects appearing in the digital images. The method mayfurther include 406 linking the virtual world interactive interface foraccess via an online real estate listing for property including thephysical place. Prospective buyers may therefore tour and virtuallyinspect a property for sale from the convenience of a remote accessterminal. The virtual world interface may provide additional featuresand tools to assist and encourage buyers to make a purchase decision, asdescribed in more detail above. These additional features may beintegrated into the method 400.

For example, in additional aspects, the method 400 may further includereceiving input specifying a minimum object size, and decluttering the3-D model by removing objects smaller than the minimum object size. Themethod 400 may further include enabling a user to select ones of theindependently modeled objects for removal from the 3-D model, using thevirtual world interactive interface, and creating a record of remainingones of the modeled objects in response to user removal of one or moreof the modeled objects. The method 400 may further include enabling theuser to select additional modeled objects from a catalog for adding tothe 3-D model, and creating a record of selected ones of the additionalmodeled objects in response to user selection of one or more of theadditional modeled objects. The method 400 may further include enablingthe user to determine placement of the remaining ones of the modeledobjects and the selected ones of the additional modeled objects in the3-D model, and creating a placement record. The method 400 may furtherinclude generating an order for staging the physical place, using therecord of remaining ones of the modeled objects, the record of selectedones of the additional modeled objects, and the placement record. Anexample scenario for using the foregoing operations for staging aproperty for sale has been discussed severally above.

In a separate aspect as shown in FIG. 5, a telepresence method 500 mayinclude linking 502 a robotic device placed in a physical place to aninteractive interface including a virtual 3-D model of the place, forexample, via a WAN connection. The telepresence method 500 may furtherinclude tracking 504 virtual motion of an avatar in the interactiveenvironment relative to the virtual 3-D model. In the alternative, or inaddition, the method may include tracking a current viewpoint of a userindependently of avatar movement. The telepresence method 500 mayfurther include controlling 506 movement of the robotic device in thephysical place to indicate virtual motion of the avatar in the virtual3-D model. In the alternative, or in addition, the method 500 mayinclude emitting 508 a beam of light from the robotic device to indicatea direction of gaze of the avatar. In the alternative, the beam of lightmay be controlled to indicate a current user viewpoint in the virtualspace.

The telepresence method 500 may further include operating an audio linkbetween the robotic device and a user controlling the avatar in theinteractive environment. The telepresence method 500 may further includeprojecting an image from the robotic device to indicate a position ofthe avatar in the virtual 3-D model. The telepresence method 500 mayfurther include projecting the image from the robotic device includingan image of a user controlling the avatar in the interactiveenvironment.

The various illustrative logical blocks, modules, circuits, andalgorithm steps described in connection with the disclosure herein maybe implemented as electronic hardware, computer software, orcombinations of both. To clearly illustrate this interchangeability ofhardware and software, various illustrative components, blocks, modules,circuits, and steps have been described above generally in terms oftheir functionality. Whether such functionality is implemented ashardware or software depends upon the particular application and designconstraints imposed on the overall system. Skilled artisans mayimplement the described functionality in varying ways for eachparticular application, but such implementation decisions should not beinterpreted as causing a departure from the scope of the presentdisclosure.

For example, the various illustrative logical blocks, modules, andcircuits described in connection with the disclosure herein may beimplemented or performed with a general-purpose processor, a digitalsignal processor (DSP), an application specific integrated circuit(ASIC), a field programmable gate array (FPGA) or other programmablelogic device, discrete gate or transistor logic, discrete hardwarecomponents, or any combination thereof designed to perform the functionsdescribed herein. A general-purpose processor may be a microprocessor,but in the alternative, the processor may be any conventional processor,controller, microcontroller, or state machine. A processor may also beimplemented as a combination of computing devices, e.g., a combinationof a DSP and a microprocessor, a plurality of microprocessors, one ormore microprocessors in conjunction with a DSP core, or any other suchconfiguration.

The steps of a method or algorithm described in connection with thedisclosure herein may be embodied directly in hardware, in a softwaremodule executed by a processor, or in a combination of the two. Asoftware module may reside in RAM memory, flash memory, ROM memory,EPROM memory, EEPROM memory, registers, hard disk, a removable disk, anoptical disc, or any other form of storage medium known in the art. Anexemplary storage medium is coupled to the processor such that theprocessor can read information from, and write information to, thestorage medium. In the alternative, the storage medium may be integralto the processor. The processor and the storage medium may reside in anApplication-Specific Integrated Circuit (ASIC). The ASIC may reside in agaming device or other system element. In the alternative, the processorand the storage medium may reside as discrete components in a gamingdevice or other system element.

In one or more exemplary designs, the functions described may beimplemented in hardware, software, firmware, or any combination thereof.If implemented in software, the functions may be stored on ortransmitted over as one or more instructions or code on acomputer-readable medium. Computer-readable media includes both computerstorage media and communication media including any non-transitorymedium that facilitates transfer of a computer program from one place toanother. A storage media may be any available media that can be accessedby a general purpose or special purpose computer. By way of example, andnot limitation, such computer-readable media can comprise RAM, ROM,EEPROM, CD-ROM, DVD, Blu-ray or other optical disc storage, magneticdisk storage or other magnetic storage devices, or any other medium thatcan be used to carry or store desired program code means in the form ofinstructions or data structures and that can be accessed by ageneral-purpose or special-purpose computer, or a general-purpose orspecial-purpose processor. Disk and disc, as used herein, includes butis not limited to compact disc (CD), laser disc, optical disc, digitalversatile disc (DVD), magnetic hard disk and Blu-ray disc, wherein disksusually reproduce data magnetically, while discs reproduce dataoptically with lasers. Combinations of the above should also be includedwithin the scope of computer-readable media.

Processes performed by the gaming machines, or system nodes describedherein, or portions thereof, may be coded as machine readableinstructions for performance by one or more programmable computers, andrecorded on a computer-readable media. The described systems andprocesses merely exemplify various embodiments of enhanced features foruse in an apparatus, method or system for gaming. The present technologyis not limited by these examples.

What is claimed is:
 1. A method comprising: at an electronic devicecomprising one or more processors and non-transitory memory: detecting atriggering event at a defined physical place; in response to detectingthe triggering event: obtaining digital images of the defined physicalplace; determining, based on the digital images, a surface geometry ofthe defined physical place and one or more texture maps; and creating,in the non-transitory memory, a 3-D model of the defined physical placeusing the surface geometry and the one or more texture maps; providing auser interface for remote access to the 3-D model, wherein the digitalimages used to create the 3-D model of the defined place are captured byone or more devices that are not controlled by a user of the userinterface; and enabling an avatar operated by the user of the userinterface to enter, tour and interact with the 3-D model of the definedphysical place.
 2. The method of claim 1, wherein detecting thetriggering event includes monitoring queries provided to a search engineincluding an identifier for the defined physical place.
 3. The method ofclaim 1, wherein detecting the triggering event includes monitoring acurrent popularity of news stories that include an identifier for thedefined physical place.
 4. The method of claim 1, wherein detecting thetriggering event includes monitoring a news feed for a newsworthy eventtaking place at the defined physical place.
 5. The method of claim 1,wherein detecting the triggering event includes monitoring a real estatelisting including an identifier for the defined physical place.
 6. Themethod of claim 1, wherein obtaining the digital images of the definedphysical place is performed in real or near real time.
 7. The method ofclaim 1, wherein enabling the avatar to enter, tour and interact withthe 3-D model of the defined physical place is performed in real or nearreal time.
 8. The method of claim 1, wherein the digital images arephotographic images.
 9. The method of claim 1, wherein the digitalimages are video images.
 10. The method of claim 1, wherein providingthe user interface providing the user interface includes enabling use ofthe 3-D model in an online virtual world environment.
 11. Anon-transitory computer-readable medium having instructions encodedthereon which, when executed by one or more processors of an electronicdevice, cause the electronic device to: detect a triggering event at adefined physical place; in response to detecting the triggering event:obtain digital images of the defined physical place; determine, based onthe digital images, a surface geometry of the defined physical place andone or more texture maps; and create, in a computer memory, a 3-D modelof the defined physical place using the surface geometry and the one ormore texture maps; provide a user interface for remote access to the 3-Dmodel, wherein the digital images used to create the 3-D model of thedefined place are captured by one or more devices that are notcontrolled by a user of the user interface; and enable an avataroperated by the user of the user interface to enter, tour and interactwith the 3-D model of the defined physical place.
 12. The non-transitorycomputer-readable medium of claim 11, wherein the instructions, whenexecuted, cause the electronic device to detect the triggering event bymonitoring queries provided to a search engine including an identifierfor the defined physical place.
 13. The non-transitory computer-readablemedium of claim 11, wherein the instructions, when executed, cause theelectronic device to detect the triggering event by monitoring a currentpopularity of news stories that include an identifier for the definedphysical place.
 14. The non-transitory computer-readable medium of claim11, wherein the instructions, when executed, cause the electronic deviceto detect the triggering event by monitoring a news feed for anewsworthy event taking place at the defined physical place.
 15. Thenon-transitory computer-readable medium of claim 11, wherein theinstructions, when executed, cause the electronic device to detect thetriggering event by monitoring a real estate listing including anidentifier for the defined physical place.
 16. The non-transitorycomputer-readable medium of claim 11, wherein the instructions, whenexecuted, cause the electronic device to obtain the digital images ofthe defined physical place in real or near real time.
 17. Thenon-transitory computer-readable medium of claim 11, wherein theinstructions, when executed, cause the electronic device to enable theavatar to enter, tour and interact with the 3-D model of the definedphysical place in real or near real time.
 18. An electronic devicecomprising: a non-transitory memory; one or more processors to: detect atriggering event at a defined physical place; in response to detectingthe triggering event: obtain digital images of the defined physicalplace; determine, based on the digital images, a surface geometry of thedefined physical place and one or more texture maps; and create, in acomputer memory, a 3-D model of the defined physical place using thesurface geometry and the one or more texture maps; provide a userinterface for remote access to the 3-D model, wherein the digital imagesused to create the 3-D model of the defined place are captured by one ormore devices that are not controlled by a user of the user interface;and enable an avatar operated by the user of the user interface toenter, tour and interact with the 3-D model of the defined physicalplace.
 19. The electronic device of claim 18, wherein the one or moreprocessors are to detect the triggering event at the defined physicalplace by a news feed for a newsworthy event taking place at the definedphysical place.
 20. The electronic device of claim 18, wherein the oneor more processors are to obtain the digital images of the definedphysical place and enable the avatar to enter, tour and interact withthe 3-D model of the defined physical place in real or near real time.